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Abstract 

■ Given a finite sequence of vectors Tq in C d we describe the spectral and geometrical structure 
7— I | of optimal completions of J~o obtained by adding a finite sequence of vectors with prescribed 

norms, where optimality is measured with respect to a general convex potential. In particular, 
our analysis includes the so-called Mean Square Error (MSE) and the Benedetto-Fickus' frame 
potential. On a first step, we reduce the problem of finding the optimal completions to the 
computation of the minimum of a convex function in a convex compact polytope in M. d . As a 
second step, we show that there exists a finite set (that can be explicitly computed in terms of 
a finite step algorithm that depends on Tq and the sequence of prescribed norms) such that the 
optimal frame completions with respect to a given convex potential can be described in terms 
i— 1 1 of a distinguished element of this set. As a byproduct we characterize the cases of equality in 

■ Lindskii's inequality from matrix theory. 

: 

AMS subject classification: 42C15, 15A60. 

Keywords: frames, frame completions, majorization, Lindskii's inequality, Schur-Horn theorem. 

1 — '. Contents 

£> . 1 Introduction 

00 ■ 

^ . 2 Preliminaries 3 

£T) [ 2.1 General notations 4 

' 2.2 Basic framework of finite frames 4 

2.3 Submajorization 6 

2.4 Frames and optimal completions with prescribed parameters 7 



X 

5-! 



3 The spectrum of the minimizers of Pf on CaC^o) la 

4 Local minimizers of Pf(-) on Ca P (.Fo) [H 

4.1 The dgdocal minimizers on Ca P (-7~o) are global minimizers 12 

4.2 A geometrical approach for dp-local minimizers on Ca P (.Fo) ii 

4.3 The dp-local minimizers of Pf in Ca P (-7 7 o) are frames for H [15 

5 On the structure of global minimizers of Pf on C a (Po) 

5.1 Partitions into irreducible subsequences 17 

5.2 A finite step algorithm to compute global minimizers 19 

5.3 Algorithmic implementation: some examples and conjectures [21 

6 Appendix: Equality in Lindskii's inequality E 

6.1 Optimal matching matrices commute 24 

6.2 Characterization of optimal matching matrices [26 



*e-mail addresses: massey@mate.unlp.edu.ar , mruiz@mate.unlp.edu.ar , demetrio@mate.unlp.edu.ar 



1 



1 Introduction 



A finite sequence of vectors T = {/i}i<=i n in C d is a frame for C d if the sequence spans C d . It is well 
known that finite frames provide redundant linear encoding-decoding schemes, that have proved 
useful in real life applications. Conversely, several research problems in this field have arise in the 
attempt to apply this theory in different contexts. 

For example, the (linear) redundancy provided by finite frames translates into robustness 
properties of the transmission scheme that they induce, which make frames a useful device for 
transmission of signals through noisy channels; this last fact has posed several problems dealing 
with the determination of what is known in the literature as optimal frames for erasures (see 

Efl U E5J ESI M M) ■ 

On the other hand, the so-called tight frames allow for redundant linear representations of 
vectors (signals) that are formally analogous to the linear representations given by orthonormal 
basis; this feature makes tight frames a distinguished class of frames that is of interest for appli- 
cations. Conversely, in several applications we would like to consider tight frames that have some 
other prescribed properties leading to what is known in the literature as frame design problems 
[H El [101 HU [171 HSl [HH [26]. It is worth pointing out that in some cases it is not possible to find a 
frame fulfilling the previous demands; in [2] Benedetto and Fickus found an alternative approach 
to these situations by introducing a functional, called the frame potential, and showing that mini- 
mizers of the frame potential (within a convenient set of frames) are the natural substitutes of tight 
frames with prescribed parameters (see also [21 EH [231 SO] and [HJ EH [32] for related problems in 
the context of fusion frames). 

Recently, the following frame completion problem, related with the frame design problems 
mentioned above, was posed in [20]: given an initial sequence Fq in C d and a sequence of positive 
numbers a then compute the sequences Q in C d whose elements have norms given by the sequence 
a and such that the completed sequence F = (Fq , Q) minimizes the so-called mean square error 
(MSE) of F, which is a (convex) functional (see also [51ll9[[2^] for completion problems for frames). 
The initial sequence of vectors can be considered as a checking device for the measurement, and 
therefore we search for a complementary set of measurements (given by vectors with prescribed 
norms) in such a way that the complete set of measurements is optimal with respect to the MSE. 
Notice there are other possible (convex) functionals that we could choose to minimize such as, for 
example, the frame potential. Therefore, a natural extension of the previous problem is: given a 
(convex) functional defined on the set of frames, compute the frame completions with prescribed 
norms that minimize this functional. 

A first step towards the solution of this general version of the completion problem was made in 
[33| . There we showed that under certain hypothesis (feasible cases, see Section r2.4|) . optimal frame 
completions with prescribed norms do not depend on the particular choice of convex functional, as 
long as we consider convex potentials, that contain the MSE and the frame potential (see Section 
12. 2p . On the other hand, it is easy to show examples in which the previous result does not apply 
(non- feasible cases); in these cases the optimal frame completions with prescribed norms are not 
known even for the MSE nor the frame potential. 

In this paper we consider the frame completion problem of an initial sequence Fq in C d , for 
general sequences a of prescribed norms and for a fixed convex potential Pf - where / is a strictly 
convex function - in the non- feasible cases (see Section [23] for motivations and a detailed description 
of our main problem). In order to deal with the general problem we introduce and develop a class 
of pairs of positive matrices (called optimal matchings matrices, see the Appendix) that allow to 
reduce the problem to the computation of minimizers of a scalar convex function F (associated 
to /) in a compact convex domain in M. d (the same set for every map /). This constitutes a 
reduction of the optimization problem, that in turn can be attacked with several numerical tools 
in concrete examples. In fact, the convex domain has a natural and explicit description in terms 
of majorization, which is an algorithmic notion. 
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We also study the spectral and geometrical structure of local minimizers of Pf in the set of frame 
completions with prescribed norms, in terms of a geometrical approach to a perturbation problem. 
These last results allow to a second reduction of the problem: there is a finite set E(Tq , a) in M. d - 
that depends only on the initial family J-q and the finite sequence a of positive numbers - such that 
for any fixed convex potential Pf there exists a unique vector \i = /j,f € E{Tq , a) (computable by 
a minimization on the finite set E^q , a) in terms of F) such that all optimal frame completions 
for Pf with prescribed norms can be computed in terms of /i. 

In both methods, we describe the optimal vector of eigenvalues for the frame operator of the 
completing sequences. With this data, the optimal completions (which satisfy the norm restrictions) 
can be effectively computed by using a well known algorithm developed in [17] that implements 
the Schur-Horn theorem. 

In all examples that we have computed numerically, we have found that the optimal spectrum 
of the completing sequences does not depend on the particular choice of convex potential Pf consid- 
ered. Although at the present we have not been able to prove this fact, we state it as a conjecture. 
We have also observed two other common features of optimal solutions - that are also stated as 
conjectures - that allow to implement an efficient (and considerably faster) algorithm that computes 
an smaller set than E(J-q , a) that also enables to compute the optimal frame completions with 
prescribed norms with respect to a general convex potential Pf. 

The paper is organized as follows. In Section [2] we state several facts and notions about frame 
theory in finite dimension and majorization, which is a notion from matrix theory; in this section 
we describe in detail the main problem of the present paper and some previous related results. In 
section [3] we reduce the problem of computing optimal frame completions with prescribed norms 
to a set of completions whose frame operators are optimal matchings of the frame operator of 
the initial set of vectors Tq, in the sense described in the Section E] (Appendix). Based on the 
results of the Appendix we obtain a first reduction of the problem and show that the optimal frame 
completions with prescribed norms for the convex potential Pf can be described in terms of the 
minimizers of an associated function F in a compact convex polytope. We also show that the 
spectral structure of optimal completions is unique and has some other features. In Section 2] we 
introduce two different topologies in the set of completions and consider the geometrical structure of 
local minimizers with respect to these topologies; in order to do this we apply tools from differential 
geometry that allow to solve a local perturbation problem for frames with prescribed norms. Using 
these results we show in Section [5] that optimal completions T = {Pq,Q) have the property that 
the vectors of the completing sequence Q are eigenvectors of the frame operator Sjr of the complete 
sequence T . Based on this last fact we develop an algorithm (that can be effectively implemented) 
to compute optimal completions numerically. The analysis of the computed examples reflects some 
commons features of the numerical solutions. Based on these facts we state some other conjectures 
related with the spectral structure of optimal completions. Finally, in Section Owe introduce pairs 
of positive matrices, that we call optimal matchings, and describe the structure of these pairs; this 
corresponds to the study of the case of equality in Lindskii's inequality from matrix theory. 

2 Preliminaries 

In this section we describe the basic notions that we shall consider throughout the paper. We first 
establish the general notations and then we recall the basic facts from frame theory that are related 
with our main results. Then, we describe submajorization which is a notion from matrix analysis, 
that will play a major role in this note. Finally, we recall the solution of the frame design problem 
in terms of majorization and give a detailed description of the optimal frame completion problem, 
which is the main topic of this paper. 
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2.1 General notations. 



Given m G N we denote by I m = {1, . . . , m} C N and 1 = l m G M. m denotes the vector with all 
its entries equal to 1. For a vector x G W 71 we denote by (resp. x*) the rearrangement of x in 
decreasing (resp. increasing) order, and (M m )^ = {x G M. m : x = x^} the set of downwards ordered 
vectors. 

Given ft = C d and K, = C n , we denote by L(ft , /C) the space of linear operators T : W JC. 
Given an operator T G L(% , /C), i?(T) C /C denotes the image of T, kerT C ft the null space 
of T and T* 6 L(/C , ft) the adjoint of T. If /C = ft we denote by L(ft) = L(H , ft), by gi[U) 
the group of all invertible operators in L(7i), by L(ft) + the cone of positive operators and by 
gi(H) + = Gl(H)r\L{H) + . If T G L{H), we denote by a (T) the spectrum of T, by rk T = dim i2(T) 
the rank of T, and by tr T the trace of T. 

By fixing orthonormal basis's (ONB's) of the Hilbert spaces involved, we shall identify operators 
with matrices, using the following notations: by M. n ^{C) = L(C d , C ra ) we denote the space of 
complex n x d matrices. If n = d we write .Md(C) = TWrf^(C) ; 1-L{d) is the M-subspace of 
selfadjoint matrices, Ql{d) the group of all invertible elements of Md(C), U{d) the group of unitary 
matrices, A4d(C) + the set of positive semidefinite matrices, and Ql(d) + = M.d(C) + n Ql(d). 

If W C % is a subspace we denote by Pw G L(7i) + the orthogonal projection onto W, i.e. 
R(P\y) = W and ker P\y = W . Given x , y G H we denote by x ® y G the rank one 

operator given by x ® y (z) = (z , y) x for every z G %. Note that if = 1 then a; ® x = P span { x } ■ 

Given S G .M^C)^ ', we write A(5) G (R^q)^ the vector of eigenvalues of 5 - counting multiplicities 
- arranged in decreasing order. If X(S) = A = (Ai , . . . , A^) G (M> )~'- , a system B = {hi}i € i d C C d 
is a "ONB of eigenvectors for S , A " if it is an orthonormal basis for C rf such that S hi = Ai hi for 
every i G 1^ . In other words, an orthonormal basis 

B = {hi}i(zi d is a "ONB of eigenvectors for S , A" <^=^ 5 = Aj • hi® hi . (1) 

For vectors in C rf we shall use the euclidean norm. On the other hand, for T G A / l nj d( ( C) we shall 
use the spectral norm, denoted ||T||, given by ||T|| = ™p x 

2.2 Basic framework of finite frames 

In what follows we consider (n, d)-frames. See [21 (9J [161 E21 ED] for detailed expositions of several 
aspects of this notion. 

Let d,n G N, with d < n. Fix a Hilbert space H = C d . A family J 7 = {/i} iG n„ G U a is an 
(n, d)-frame for TL if there exist constants A, B > such that 

-4||a;|| 2 < Yl I I 2 - ^II^H 2 for every x e H . (2) 

i=l 

The frame bounds, denoted by Aj^Bj are the optimal constants in ([2]). If Ajr = Bjr we call 
T a tight frame. Since dimH < oo, a family J 7 = {fi}i£i n is an (n,d)-frame if and only if 
span{/j : i G I n } = Ti. We shall denote by F = F(n , d) the set of all (n, d)-frames for 

Given T = {fi} ie i n G U n , the operator Tj- G L{H , C n ) defined by 

Tjrx= ( (x , /i) ) . 6ln , for every x G ft (3) 
is the analysis operator of T . Its adjoint Tji- is called the synthesis operator: 

T> G L(C n , ft) given by T* T v = £ Wi /i for every u = ( Wl , . . . , u n ) G C n . 
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Finally, we define the frame operator of T as 

S T = T* T 2> = Y, fi ® fi € L{U) + . 

Notice that, if T = {fi}iei n G Ti n then (Sj^x, x) = Yliei I ( x > /*) I ^ or evei T x <E 7~L. Hence, 
T G F(n, d) if and only if Sjr g Ql{T-L) + and in this case Ajr||x|| 2 < (Sj^x, x) < Bjr\\x\\ 2 for 
every x G H. In particular, Aj = A m i n (5j-) = US" 1 ]] -1 and A max (£j-) = = Bjr . Moreover, 

T is tight if and only if Sj- = § 1% , where r = tr S> = £ i€lfi ||/i|| 2 . 

The frame operator plays an important role in the reconstruction of a vector x using its frame 
coefficients {(x , fi) }?,<=i n - This leads to the definition of the canonical dual frame associated to 
J-: for every T = {/i}iel n ^ F(n i d), the canonical dual frame associated to T is the sequence 
T* G F defined by 

J-# d = ( S T X ■ T = {S^ 1 fi } ieIm G F(n , d) . 
Therefore, we obtain the reconstruction formulas 

x=Y(x, fi) S^ 1 fi = ^2(x, S^ 1 fi) fi for every x G % . (4) 

i&n i&n 

Observe that the canonical dual J 7 * satisfies that given x EH, then 

Tr#x={(x,S?fi)) i&n =((S T 1 x,f t )) mn for zen => T^^TjrS?. (5) 
Hence T* J# 7> = I H and = S^ 1 7£ 7> S^ 1 = S^ 1 . 

In their seminal work [2J, Benedetto and Fickus introduced a functional defined (on unit norm 
frames), the so-called frame potential, given by 

fp({/*WJ= £ K/i,/;>l 2 - 

i, 3 Gin 

One of their major results shows that tight unit norm frames - which form an important class of 
frames because of their simple reconstruction formulas - can be characterized as (local) minimizers 
of this functional among unit norm frames. Since then, there has been interest in (local) minimizers 
of the frame potential within certain classes of frames, since such minimizers can be considered as 
natural substitutes of tight frames (see [I5J [30j EI] ) ■ Notice that, given T = {/i}iei„ G H n then 
FP (J 7 ) = tr Sjr = J2iei d ^(Sj 7 ) 2 - These remarks have motivated the definition of general convex 
potentials as follows: 

Definition 2.1. Let / : [0 , oo) — > [0, oo) be a convex function. Following [30J we consider the 
(generalized) convex potential associated to /, denoted Pf, given by 

P f {T) = tr f(S T ) for T = {/i}?,<=i n G H n . A 

Of course, one of the most important convex potential is the Benedetto-Fickus' (BF) frame po- 
tential. As shown in |3CH Sec. 4] these convex functionals (which are related with the so-called 
entropic measures of frames) share many properties with the BF-frame potential. Indeed, under 
certain restrictions both the spectral and geometric structures of minimizers of these potentials 
coincide (see [50]). 

Remark 2.2. The results that we shall develop in this work apply in the case of convex potentials 
Pf for a strictly convex function / : [0, oo) R. Notice that this formulation does not formally 
include the Mean Square Error (MSE), which is the convex potential associated with the strictly 
convex function / : (0, oo) — > (0, oo) given by f{x) = x~ l , since / is not defined in in this case. 
In order to include the MSE within our results we proceed as follows: we define / : [0, oo) — > (0, oo] 
given by f(x) = x -1 for x > and /(0) = oo. Assuming that x < oo and x + oo = x- oo = oo for 
every x G (0 , oo), it turns out that the new map / is a (extended) strictly convex function and all 
the results obtained in this paper apply to the convex potential induced by /. A 
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2.3 Submajorization 

Next we briefly describe submajorization, a notion from matrix analysis theory that will be used 
throughout the paper. For a detailed exposition of submajorization see [3]. 

Given x, y E M. d we say that x is submajorized by y, and write x -< w y, if 

k k 

x\ < ^2 yj f° r every fc G I<f . 
i=l i=l 

If x -< w y and trx = Ya=i x i = Sf=i ?/i = ^y, then we say that x is majorized by y, and write 
x ~< y. If the two vectors x and y have different size, we write x -< y if the extended vectors 
(completing with zeros to have the same size) satisfy the previous relationship. 

On the other hand we write x ^ y if Xj < yi for every i Eld - It is a standard exercise to show that 
x ^ y x^ ^ ==> x -< w y. Majorization is usually considered because of its relation with 

tracial inequalities for convex functions. Indeed, given x, y E M d and / : I — > K a convex function 
defined on an interval ICR such that x, y E then (see for example [3]): 

def d d 

1. If one assumes that x <y, then tr/(x) = ^ /(xj) < ^ /(?/«) = tr f(y) . 

i=l i=i 

2. If only x -< w y, but the map / is also increasing, then still tr/(x) < tr/(y). 

3. If x y and / is a strictly convex function such that tr f(x) = tr f(y) then there exists a 
permutation a of Id such that yi = x a u\ for i Eld- 

Remark 2.3. Majorization between vectors in M. d is intimately related with the class of doubly 
stochastic d x d matrices, denoted by DS(d). Recall that a d x d matrix D E DS((i) if it has 
non- negative entries and each row sum and column sum equals 1. 

It is well known (see [3]) that given x , y E M. d then x -< y if and only if there exists D E DS(d) 
such that Dy = x. As a consequence of this fact we see that if x\ , y\ E W and X2 , 2/2 G are 
such that Xi ~< yi , i = 1 , 2, then x = (xi , X2) -< y = (yi , J/2) in M r+S . 

Indeed, if D% and Z?2 are the doubly stochastic matrices corresponding the previous majorization 
relations then D = D\ © D2 E DS(r + s) is such that Dy = x. A 

Submajorization can be extended to the context of self-adjoint matrices as follows: given Si , S2 E 
we say that Si is submajorized by S2 , denoted S% -K w S2 > if A(Si) A(S2) • If Si S% 
and tr Si = tr S2 we say that Si is majorized by 62 and write Si -< S2 ■ Thus, Si -< S2 if and 
only if X(Si) ~i A(S < 2). Notice that (sub)majorization is a spectral relation between self-adjoint 
operators. 

We end this section by recalling the following result, known as Lindskii's inequality (see III. 4]). 
Theorem 2.4 (Lindskii's inequality ). Let A, B E U{d). Then \{A) + tf{B) -< X(A + B). □ 

Lindskii's inequality plays an important role in our study of optimal frame completion problems. 
Moreover, the case of equality in Lindskii's inequality, i.e. when (A(A) + X'(B))^ = X(A + B) for 
A, B E 7i(d), plays a central role in this paper. We completely characterize such pair of matrices 
- that we call optimal matching matrices - in the Appendix. 
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2.4 Frames and optimal completions with prescribed parameters 

In several applied situations it is desired to construct a sequence T in such a way that the frame 
operator of T is given by some S G M. d ( < C) + and the squared norms of the frame elements are 
prescribed by a sequence of positive numbers a = (aj)j S n n G R™ • That is, given a fixed S G 
A4d(C) + and a G R™ , we analyze the existence (and construction) of a sequence T = {/i}igi„ 
such that Sjr = S and ||/i|[ 2 = a% , for i G I n . This is known as the classical frame design problem. 
It has been treated by several research groups (see for example [TJ [TUJ [131 El EH EE [26] ) • In 
what follows we recall a solution of the classical frame design problem in the finite dimensional 
setting, in the way that it is convenient for our analysis. 

Proposition 2.5 ([UES]). Let B G M d (C) + with X(B) GR^ and let a = (ai) i&k G . Then 
there exists a sequence Q = {gi}iei k £ with frame operator Sg = B and such that ||(?i|| 2 = 
for every i G 1^ if and only if a -< \{B) (completing with zeros if k ^ d). □ 

Recently, researchers have made a step forward in the classical frame design problem and have 
asked about the structure of optimal frames with prescribed parameters. For example, consider 
the following problem posed in [20]: let Ti. = C d and let Fq = {/i}jgn no G ~H n ° be a fixed (finite) 
sequence of vectors. Consider a sequence a = (ai)i e j k G R> such that rkS_F > d — k and denote 
by n = n + k. Then, with this fixed data, the problem is to construct a sequence 

G = {/iKUo+l G wi th ll/n 0+i || 2 =ai for 1 < i < fc , 

such that the resulting completed sequence is a frame J 7 = {Fq , £) = {/ijiein £ F(n, d) whose 
MSE tr Sp l is minimal among all possible such completions. 

Note that there are other possible ways to measure robustness (optimality) of the completed frame T 
as above. For example, we can consider optimal (minimizing) completions, with prescribed norms, 
for the Benedetto-Fickus' potential. In this case we search for a frame T = (7"o , G) = {fi}i& n £ 
F(n, d), with ||/ no+ j|j 2 = Qj for 1 < i < A;, and such that its frame potential FP (J 7 ) = tr Sjr is 
minimal among all possible such completions. Indeed, this problem has been considered before in 
the particular case in which J r o = 0in[21[ni[2ll[Ml[3Q]. 

In this paper we shall consider the problems of optimal completion with prescribed norms, where 
optimality is measured with respect to general convex potentials (see Definition 12. ip . In order to 
describe our main problem we first fix the notation that we shall use throughout the paper. 

Definition 2.6. Let J" = {fi}m no £ H n ° and a = {a,i)i^i k G M> such that d - rkS> < k. 
Define n = n + k. Then 

1. In what follows we say that (J-q , a) are initial data for the completion problem (CP). 

2. For these data we consider the sets 

CaC^o) = { {/i}iei„ £ U n : {fi}m no = To and ||/n +i|| 2 = a i for i £ h} , 
and SC a (T ) = {S T : T G C a (T )} C M d (C) + . 

When the initial data (J-q , a) are fixed, we shall use throughout the paper the notations 

So = Sjr Q , A = A (So) an d n = n + k . A 

Problem: (Optimal completions with prescribed norms with respect to Pf ) Let (J-q , a) be initial 
data for the CP and let / : [0, oo) — > R be a strictly convex function. Construct all possible 
T G Ca^o) that are the minimizers of Pf in C a (^b)- ^ 

Our analysis of the completed frame T = (To , G) will depend on T through Sjr . Hence, the 
following description of SC a (J r o) plays a central role in our approach. 
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Proposition 2.7. Let (J-q , a) be initial data for the CP. Then 



SC a (Jb) = {S£ M d (C) + : 5 > S To and a -< \(S - S Fo )} . 

Proof. Observe that if T = (To , Q) G H n then Sj = Sjr Q + Sg . Denote by So = Sjr and 
B = S — So , for S G A4 d (C) + . Applying Proposition 12.51 to the matrix B (which must be 
nonnegative if S G SC a (To) ), we get the equality of the sets. □ 

Remark 2.8 (Optimal completion problem with prescribed norms: the feasible case). Let {To , a) 
be initial data for the CP . Denote by So = Sj? , A = X(So) and t = tr A + tr a. In [33] we 
introduced the following set 

U t (S , m) = {S + B: B G M d (C) + , rkB <d-m, ti(So + B) = t } , 

where m = d — k. In [33\ Theorem 3.12] it is shown that there exist ^-minimizers in Ut(So , m). 
Indeed, there exists v = v (A , m) G (Rio) 1 - that can be effectively computed by simple algorithms 
- such that S G Ut(So , m) is a ^-minimizer if and only if X(S) = v. 

We say that the completion problem for (J-"o> a ) is feasible if fi = v — A satisfies that a -< fi, 
where v = m) is as above. In this case for any S which is a ^-minimizer in Ut(So , m) it holds 
that \(S — Sq) = [Jr and hence, by Proposition 12. 7\ we conclude that S G 5C a (J-o). Moreover, 
Proposition 12 . 71 also shows that SC^To) C Ut(So , m) and therefore S is a ^-minimizer in SC^To). 
In this case, as a consequence of the results in Section [2T3l any completion T G CJyTo) such that 
Sjr = S is a minimizer of Pf for any convex function / : [0, oo) — > M. That is, in the feasible case 
we have structural solutions of the completion problem, in the sense that these solutions do not 
depend on the particular choice of convex potential considered. 

Nevertheless, it is easy to construct examples in which the completion problem for (J-q , a) is not 
feasible. For example, consider the frame J-q G F(7, 5) whose synthesis operator is 



n 



0.9202 -0.7476 -0.4674 0.9164 0.1621 0.3172 -0.5815 

0.4556 0.0164 0.0636 1.0372 -1.6172 0.3688 0.2559 

-0.0885 -0.3495 -0.9103 0.3672 -0.6706 -0.9252 0.6281 

0.1380 -0.4672 -0.6228 -0.1660 0.9419 1.0760 1.1687 

0.7082 0.2412 -0.1579 -1.8922 -0.4026 0.1040 1.6648 



(6) 



In this case A = X(Sjr Q ) = (9,5,4,2,1) and to = tr Sj? = 21. Fix the data n = 9 (hence 
k = 2), a = (3.5, 2) and notice that then t = to + tr a = 26.5 and m = d — k = 3. Then, 
according to the results in [33] we know that the optimal spectrum for Ut(So , m) is v\ m (2&.b) = 
(9,5, 4.25 , 4.25 , 4). Therefore, we have that v — A = \i = (2.25 , 3.25) so that a -ft fi, that is the 
completion problem (.Fo,a) is not feasible. 

The structure of the optimal completions with these norms was not known, even for the MSE. In 
what follows we shall give a complete description of the optimal frame completions - with respect 
to an arbitrary convex potential - for this initial data (see Example 15. 1U|) . A 

3 The spectrum of the minimizers of Pf on C a (J-o) 

Let (J-q , a) be initial data for the CP. Let \x G M> be such that a -< /i. We consider the set 

C a (7o , fi) = {J 7 = CFo , Q) 6 C a (Jb) = A(5i) = ^} C C a (Jb) • 
Notice that if T = (To, Q) then Sj = Sjr + Sg . By Proposition 12.71 we get the following partition: 

C a (To) = [J C a (T , m) where r d (a) = {fi G (R| ) t : a -< fj,} . (7) 
Mer d (a) 
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Theorem 3.1. Consider the previous notations and fix [i = [i ' G r^(a). Then, 

1. The set A(C a (J 7 o , [if) = {X(Sj^) : T G C a p~o > A 1 )} is convex. 

2. The vector v = (X(Sj^ ) + /i)^ is a -<-minimizer in A(C a (J r o , //)). 

5. If J- = (J-q , £/) € C a (J-"o , /x) is suc/i i/iai X(Sj?) = v then Sjr and Sg commute. 

Proof. 1. First notice that the set of all frame operators Sg G A4d(C) + such that J- = (To , Q) G 
C a (To > A*) is closed under unitary equivalence. Indeed, if U G U(n), then J7 5g C* is the frame op- 
erator of the sequence U-Q = {^/i}iL n +1 • Denote by A = X(Sjr ). Therefore, it is straightforward 
to check that 

A(C a (P , fi)) = {X(C) : C = A + B, A, B G H(n), X(A) = X and X(B) = /x} . 

By Klyachko's theory on the sum of hermitian matrices with a given spectra [25] , we conclude 
that the set A(C a (J 7 o , A 4 )) is convex. 

2. Since the set of all frame operators Sg G M.d(C) + such that T = (To , Q) G C a (J"o > m) is 
closed under unitary equivalence it is clear that v G A(C a (J r o , [i)). On the other hand, given 
T = (To, 9) G CaC^o ) A 4 )' then Lindskii's inequality (see Theorem I2.4p states that the vector 
v -< A(Sj- + 5g) = A(5jr). This establishes that f is a -<-minimizer in A(C a (J-Q , [if). 

3. This is a restatement of Theorem 16.41 □ 

Remark 3.2. Consider the previous notations and fix [i = [v G r^(a). Let / : [0 , oo) — > [0 , oo) 
be a strictly convex function and let Pf be the convex potential induced by /. By the results 
described in Section [231 and Theorem 13.11 we see that, if A = X(Sj? ) then 

T G argminlP/^) : Q G C a (P , //)} A(5^) = (A + [if = ( A+ + f . (8) 

That is, if we consider the partition of C a (To) described in Eq. Q, then in each slice C a (To , [i) 
the minimizers of the potential Pf are characterized by the spectral condition (|8|). 

This shows that in order to search for global minimizers of Pf on C a (To) we can restrict our 
attention to the set 

C°P(7o) d = f {T=(T ,g)eC a (T ): X(Sf) = (X(Sr ) + XHS g )) 1 } . (9) 
Indeed, Eqs. (|7|) and ([SD show that if J 7 is a minimizer of Pf in C a (To) then T G C a p (J r o), i.e. 

argmin {P^J") : T € C a (T )} = argmin {P f (T) : T G C° a p (T )} . (10) 
Since the potential Pf(T) depends on J 7 through the eigenvalues of Sj- we introduce the set 

S(C° a p (T )) = {S T : T G C° P (P )} C M d (C) + . (11) 
Finally, for any A G M> , in what follows we shall also consider the set 

A° P (A) = {X i + [i : [i G T d (a)} = {X 1 + ^ : [i G Kj and a -< //} . A 
Theorem 3.3. Let (To , a) be initial data for the CP. Denote by X = X(Sjr Q ). Then 

1. The set A a p (A) is compact and convex. 

2. The spectral picture {X(S r ) : T G C a p (P )} = {v^ : v G A° P (A)}. 
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3. If T = (Fq , Q) G Ca P (J r o), with X^(Sg) = p> then there exists {vi : i G Id} an ONB of 
eigenvectors for Sj? , A such that 

Sg = m ■ vi <S> Vi and Sjr = Sjr Q + Sg = (Aj + iij) U* <g> . (12) 

ieid i&d 

Proof. 1. If i/ , 7 G A a p (A) then there exist /x , p G r<j(a) such that = A^ + /i, 7 = A^ + p. Note 
that r^(a) is convex. Hence, if t G (0, 1), then p t = tfj,+ (l — t)p€ r^(a) and 

ti/+(l-t) 7 = A+ + i/i + (l-i)p = ^ + Ht G A° P (A) . 

Item 2. is an immediate consequence of the definitions of A a p (A) and Ca P (J~o)- 

3. Let .F = (Fq , £/) G C a (J-o)° p - Then the frame operator Sg is an optimal matching matrix for 
Sjr Q in the sense of Eq. [35] (see the Appendix). Hence, the existence of an ONB {vi : i G Id} for 
So , A satisfying Eq. (|12p follows from Theorem 16.81 □ 

Let (Fo , a) be initial data for the CP. Recall that r^(a) = {p G (R> )T : a -< p}. In what follows 
we use the following notation: if / : [0, 00) — > R is a function we consider F : R> — > R given by 
i ? (7) = E, e n d /(70, for 7 GR^ . 

Theorem 3.4. Let (Fo , a) be initial data for the CP and let f : [0 , 00) — >• [0 , 00) be a strictly 
convex function. Then there exists a vector p(X , a , f) = p = fj, G r^(a) suc/i i/iai: 

1. F = (To , <?) G C a (Fo) is a global minimizer of Pj F G Ca P (F"o) A ' (<Sg) = p. 

,2. // uie Zei A = A(5' j f ) i/ien /z is uniquely determined by the conditions 

fi G r d (a) and F(A + p) = min ^( A + 7) = min F(v) . (13) 

7er d (a) ^eAa p (A) 

3. Moreover, \x also satisfies that 

< m = Hi+i => \ = Aj+i for every i G . (14) 

Proof. Notice that the map F : Ri -> [0 , 00) is also strictly convex, and it is invariant under 
permutations of the variables. Moreover, 

P f (F) = tr f(S T ) = F(\(S T )) for every F G C a (F ) . (15) 

Since A a p (A) is compact and convex and F is strictly convex then every local minimizer of F on 
Aa P (A) coincide with a unique global minimizer denoted by v = z/(a, A , /) G A a p (A). Define 
H = v — A and notice that, by construction of the set A a p (A), h = A* and a ^ M- 

Recall that given J 7 = (Fo , (?) G C a (Fo) then a necessary condition for J 7 to be a global minimizer 
of Pf on C a (Fo) is that T G Ca P (Fo) (see Remark l3.2[) . Hence, by item 2 in Theorem 13.31 the fact 
that F is permutation invariant and Eq. (|15p we conclude that J 7 G C a (Fo) is a global minimizer 
of Pf on C a (Fo) if and only if 

F = (To , G) G C° p (Jo) and A(^) = ( A + A t (5 s ) ) 4 = iA . 

Denote by p = X'(Sg). Then a -< p = p^ and hence A + p G A a p (A) is a minimizer of F 
A + p = v •<=>■ p = /i. 

Assume now that < Hi = A*i+i but Aj > Aj + i for some i G I^-i • We denote by p the vector 
obtained from p be replacing the i-th and (i + l)-th entries of p by 
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Pi = Hi — £ and pi + \ = pi + \ + e , where < e < min{ '- 2 ' +1 , pi} . 

Although it is possible that p ^ p>, the facts that (pi , Pi+i) -< (pi , Pi+i) and pj = pj for every 
j G (Id \ {i , i + 1}) imply, by Remark 12.31 that p ~< p and hence a -< p -< p. Using Proposition 
12.71 and fixing an ONB for Sjr , A, we deduce that there exists F' = (Fo , Q') G C a (Fo) such that 
X(Sgi) = p^ and X(Sjn) = (A + p)^. Recall that v = A + p. Note that 

Vi = Aj + pi > Aj + pi > Aj + i + > Aj + i + = Ui + \ , 

while z/j = Xj + /ij = Xj + for every j G (1^ \ {i , i + 1}). Then, by Remark 12.31 we conclude 
that A + p -< v and (A + p)^ ^ iA. Hence, if / is strictly convex the previous facts imply that 
Pf(J-') < F(v), which contradicts the minimality of v of the first part of this proof. □ 

Corollary 3.5. Let T = (Tq , Q) G C a (J-o) be a global minimizer of Pf . Then 

1. If z G cr(Sg) \ {0} then there exists w G o-(Sq) such that ker(Sg — z) C ker(5o — w). 

2. In particular, if P denotes a sub-projection of the spectral projection P(z) of Sg onto its 
eigenspace ker(Sg — z), then P and Sq commute. 

Proof. By Remark 13.21 the Pf -minimality of T = (Pq , Q) in C a (Po) implies that T G Ca P (Po)- 
Then, by Theorem 13.31 there exists {vi : i G 1^} an ONB of eigenvectors for Sq , A = A(So) such 
that Eq. (fT2|) holds. Denote by S\ = Sg , p = X^(S\) and fix z G cr(Si) \ {0}. Consider the indexes 

m(z) = min{i G 1^ : p,\ = z} and M(z) = max{z G Id '■ Pi = z} . 

By Eq. (|14p in Theorem 13.41 we know that there exists w G ct(Sq) such that Aj = w for every 
m(z) <i< M(z). Then, we can use Eq. (fT2"j) and deduce that 

ker(5g — z) = span{t>j : m(z) < i < M(z)} C ker(So — u;) . 

Therefore, any projection P as in item 2 must satisfy that P ■ So = So ■ P = wP. □ 

Remark 3.6 (First reduction of the optimal CP problem). Let (J-q , a) be initial data for the CP 
and let / : [0, oo) ->lbea strictly convex function. Consider the compact convex set A a p (A) C M> 
and define the strictly convex function F : A a p (A) — > R. Therefore F is continuous and hence 

3 ! argmin {F(x) : x G A° P (A)} = v (16) 

Theorem [331 states that p(A , a , /) = v—X. Thus, F = (Fq , Q) G C a p (J r o) is an optimal completion 
with respect to Pf if and only if X(Sg) = v — A. Thus, the minimization problem in Eq. (|16p 
constitutes a reduction of the optimization problem, that in turn can be attacked with several 
numerical tools in concrete examples. Notice that A a p (A) has a natural and explicit description in 
terms of majorization, which is an algorithmic notion. 

In the next sections we develop a different approach to the computation of minimizers of Pf in 
C a (Fo) (see Section [5^2]) . A 

4 Local minimizers of Pf(-) on C° p (J-*o) 

In applied situations it is quite useful to understand the structure of local minimizers of objective 
functions. In our case, the study of local minimizers allows us to give a detailed description of the 
geometrical structure of global minimizers. We shall consider two different topologies on the set 
C a (Fo). On the one hand, we consider the pseudo-metric d$ given by 

d s (F,F') = \\S T -S T ,\\ , 
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where || ■ || denotes the spectral norm on A4d(C). On the other hand, we also consider the punctual 
metric dp given by 

d P {F,F') = \\T F -T F ,\\ , 

where as before || • || denotes the spectral norm. It is clear that the topology induced by dp is 
strictly stronger in the sense that: if T n — ^> T then T n P, while the converse is false. Hence, 

n n 

cis-local minimizers are also dp-local minimizers. 

Let / : [0 , oo) — > [0 , oo) be a strictly convex function. Recall from Remark 13.21 that global 
minimizers of Pf on C a (Po) actually lie in Ca P (-7~o)- Therefore we shall focus our interest in the 
geometrical and spectral structure of local minimizers T G Ca P (-7 7 o) of Pf . 

4.1 The (i^-local minimizers on C° p (J"o) are global minimizers 

Remark 4.1. Let B\ = {uj}j& d and B2 = {vj}j^i d be two ONB for C d . Then there exist 
continuous curves wj : [0,1] — > C d (j G Id) such that Wj(0) = Vj , Wj(l) = uj and such that 
{wj(t)} i&d is an ONB for C d for every t G [0, 1]. 

In fact, given the unitary matrix U G U(d) such that U Vj = Uj for every j G 1^ , there exists 
a unique X G Ql(d) + with \\X\\ < 2ir such that e lX = U. Hence the continuous curve jy : 
[0, 1] — > U(d) given by ju(t) = e ltx joins 7t/(0) = / with 7f/(l) = U . Thus, the continuous curves 
Wj(t) = ^u{t)vj enjoy the mentioned properties. 

Assume further that there exists S G A4d(C) + such that both B\ and £>2 ar e ONB of eigenvectors 
for S , A = X(S). Hence, by Eq. ([1]) we have that 

S = Xi Ui Ui = Aj ^ Vi . 

i&d i&d 

In this case, it is easy to see that the unitary U G U(d) such that U Vj = Uj for every j G ILj should 
also satisfy that SU = U S and that ju(t) S = Sjuit) for every t G [0, 1]. 

Then the continuous curves Wi : [0, 1] — > C d previously constructed also satisfy that the basis 
{wi(t)}i£i d is an ONB of eigenvectors for S, A, for every t G [0,1]. In other words, for every 
t G [0, 1] we have the identity 

S = lu{t) S ju(t)* = } ] Xi lu(t) Vi <g> iu(t) v i = '^2Xi Wi(t) (g) Wi(t) . A 

i&d i&d 

Theorem 4.2. Let (J-q , a) be initial data for the CP and fix a strictly convex function f : [0, 00) — > 
[0 , 00). Then every ds-local minimizer of Pf on Ca P (J r o) must be a global minimizer. 

Proof. Let P' = (Pq , Q ') be a global minimizer of P/ in Ca P p~o)) so that A^(«Sg ') = u = u(X , a , /) 
the vector of Theorem 13.41 On the other hand take P = (Pq , Q) G Ca P (J r o) a ds-local minimizer 
of Pf on Ca P (^ r o)- We denote by S^ = So , A(S*o) = A and X^(Sg) = p. Then p, , p G T^a) and by 
Theorem 13.31 (applied to both P and J 7 ') there exist two ONB's {ui : i G ILj} and {vi : i G Id} 
such that 

5*0 = Yj u i® u 'i= Yl v i® v i > ^.F' = S + Mi) u i® u i , 
i&d i&d i&d 

(17) 

and Sjr = Y (Xi + pi) Vi®Vi . 

i&d 

Therefore, by Remark 14. 1\ there exists a family of continuous curves Wi : [0, 1] — > H such that 
Wi(0) = Vi and u>i(l) = Ui for every i G Id and such that {wi(t) : i G 1^} is an ONB for Sq and A 
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for every t G [0, 1]. Define the continuous curve s : [0, 1] — > A4d(C) + given by 

«(*) = E (A* + 1 • ih + (i - *) • ft) Mt) ® 

teid 

= 5 + AN + (!-*) 'ft) for every t e [0, 1] . 

It is clear that s(0) = Sjr and s(l) = Sp>. We claim that s(t) G S(C a p (T )) for every i G [0,1]. 
Indeed, notice that (t ■ p + (1 — t) ■ py = t ■ p + (1 — t) ■ p and therefore a -< (t ■ p + (1 — f) ■ p) for 
t G [0, 1]. Hence, there is a map S\ : [0, 1] — > M.d(C) + such that for every t G [0, 1] 

s(t) = S + si(t) , a^A(si(t)) and A(a(t)) = (A(5 ) + A t (si(t) ) ) l . 

These last facts prove our claim. Notice that then h(t) = Pf(s(t)) , t G [0, 1] is a strictly convex 
function that has local minima at t = and t = 1, i.e. h is constant. Then Pf(T) = h(0) = h(l) = 
Pf(T'), and T is another global minimizer. □ 

Remark 4.3 (On cfs-local minimizers in C a (To , p) and C a (To) and a lifting problem). The previous 
result raises the question about the spectral structure of dg-local minima of Pf on C a (To , p) or 
on CaG^o)- Indeed, let a -< p = p* and consider T a fig-local minimizer in C a (J-o , p)- As shown 
in Theorem 13.11 the set K(C a (To ; A 1 )) is convex. Therefore A(i) = i • A(Sj-) + (1 — i) • (Ao + p)^ G 
A(C a (J r o , p)) for t G [0, 1] is a continuous curve. 

Assume that we can lift the curve A(-) to a curve in S(C a (To > f 1 )) i- e -> assume that there exists a 
continuous curve 

s : [0, 1] -> 5(C a (7"o , AO) such that A(s(i)) = A(t) . (18) 

Then, we could argue as in Theorem 14.21 ab ove and conclude that A(5p) = (Ao + py, which in turn 
would also imply that d^-local minimizers of Pf on C a (.Fo) are also global minimizers. Although 
we conjecture that the lifting problem of Eq. (|18j) has a solution, we are not able to show that such 
a solution exists at this time. A 



4.2 A geometrical approach for dp-\oca\ minimizers on C° p (J-o) 

In what follows we consider a geometrical approach to the study of dp-local minimizers. Our 
results are based on a perturbation result for finite sequences of vectors, which follows from the 
work in [3T]. In order to describe the general setting, we begin by considering some well known facts 
from differential geometry. In what follows we consider the unitary group of a complex and finite 
dimensional inner product space 7Z, denoted U(TZ), together with its natural differential geometric 
(Lie) structure. 

Let (To , a) be initial data for the CP. Fix T = (To , Q) = {/j}|Li 6 C a (To)-, where n = k + n , 
1Z = R(Sg) = span{£} C C , and r = tr a = J2i=i a i > 0- Consider the real vector space 

U d (K) T = {S G U(d) : R(S) en, tr S = r} , (19) 

the cone Ld(n)f = H d {jV) T D A / I ( i(C) + , and the affine manifold 

Sjb + ?^) T = {S To + S: Se U d (nf} c fl(d) . 

We define the smooth (and so (ip-continuous) map 

$p : U(nf C a (Jb) C H n given by <M^)Ll = {/i}^ U {Oi/i+UiU . (20) 
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Finally, we consider the smooth map tyj- : U{lZ) k — > Sj- + T-Ld{TZ) T given by 

n 

*AUi)i=l =St + ® U if* = Where T ' = M^Otl ■ (21) 

i=n +l 

Let us denote by I k = (I, . . . , I) € U{lZ) k . It turns out that in several cases (indeed, in a generic 
case) the map tyj- is an open map (in Sj- + Wd(7£) r ) around ^j-(I k ) = Sjr . In order to characterize 
this situation we introduce the following notion. 

Definition 4.4. Given a sequence Q = {g%}iel n m ^ we sa y that Q is irreducible if it can not 
be partitioned into two mutually orthogonal subsequences. A 

Remark 4.5. Let ( Tq , a) be initial data for the CP. Fix T = (J~q , Q) £ C a (J-"o). Denote by 
n = k + n a and K = R(Sg) = span{£} C C d . Consider the map ^j- : U{TZ) k -> Sj + U d {K) T 
defined in Eq. (j2"T|) . 

In [31] we have characterized when the map ^>j- is a submersion in terms of certain commutant. 
Indeed, let L^iTZ) denote the (non unital) *-subalgebra of Md(C) that contains all T € A4d(C) 
such that T = PjzT Pji , where P/i denotes the orthogonal projection onto 1Z. Then, an immediate 
application of |31|, Theorem 4.2.1.] shows that tyj- is a submersion if and only if the local commutant 

M(G) = {/* ® /< : n a + 1 < i < n} ' n L d (ft) (22) 

is trivial, i.e. M{Q) = C • P-ji . Equivalently, ^/j- is a submersion iff any A € Ld(TZ) such that 
Afi = ai fi for some aj 6 C, n G + 1 < i < n, must be A = a Pr for some a E C. It is straightforward 
to show that this last condition on the family {/j <S> fi : n + 1 < i < n} is equivalent to the fact 
that the sequence Q is irreducible, in the sense defined above. Thus, we have proved the following 
statement: A 

Proposition 4.6. Let (Pq , a) be initial data for the CP. Fix T = (J-q , Q) € C & {J-q). Denote by 
n = k + n a and 1Z = R(Sg) = span{£/} C C d . Then the following statements are equivalent: 

1. The map of Eq. fl2TJ) is a submersion at I k G U{TZ) k . 

2. The sequence Q is irreducible. 

In this case, the image of Vl/j- contains an open neighborhood of ^j-(I k ) = Sj- in Sj- + 7id{Tt) T ■ 
Hence, ^>j admits a smooth local cross section ip around Sjr such that ip(Sj-) = I k . □ 

Next we state a convenient reformulation of Proposition 14.61 in terms of the distance dp . 
Corollary 4.7. Let (J-q , a) be initial data for the CP. Consider the smooth map 

S:C a {T )^Sj- +H d {K) T given by S(P) = Sj- = Sj- + Sg (23) 

for every T = (Pq , Q) € C a (Po). If we assume that a point P = [Fq , G) € C a (Po) satisfies that 
the sequence Q is irreducible, then 

1. The image of S contains an open neighborhood of Sj in Sjr + 7id(TZ) T ■ 

2. The map S has a dp-continuous local cross section ip around Sjr such that (p(Sj-) = T . 

Proof. Just define the dp-continuous local cross section (p = $j- o ip, where ip is the smooth local 
cross section for ^fj- of Proposition 14.61 and $jr is the map of Eq. ([20]) . □ 
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4.3 The dp-local minimizers of Pf in C° p (To) are frames for Ti 

Definition 4.8. Let T = {fi}iei k Q % "■ A partition of T into irreducible subsequences is 

a family {T}i£i p given by a partition II = {Ji}iei p of the index set in such a way that each 
T{ = {/j}jeJ, satisfies that: 

• The subspaces Wj = span-fT^} (i G I p ) are mutually orthogonal. 

• Each subfamily T (i G I p ) is irreducible. A 

Notice that any sequence T = {fi}iei k ^ 7~L k has a unique such partition. To see this, consider the 
subspace 1Z = spanjj 7 } C C d and the (non-unital) *-subalgebra Ai(T) = {fi®fi : i G Ik} 'r\Ld(H). 
If J 7 is not irreducible, then A4(T) contains a unique sequence of minimal orthogonal projections 
{Qi}iei p such that Qi Qj = for i, j G I p such that i 7^ j and X)iei p Q* = ^ ■ ^ n * n ^ s case > we 
have that 

Qi fj = fj for every i G I p and j G I fc , 

where e(i,j) G {0,1}. Let Jj = {j G : e(i,j) = 1} for i G I p . Let II = {Ji}iei p . The fact 
that Sigip Q« = implies that II is a partition of I p . The fact that {Qi}i<=i p is a family of 
mutually orthogonal projections imply that the subspaces W% = span{/j : j G Jj} = R(Qi) are 
mutually orthogonal, while the fact that each Qi is a minimal projection in Ai(T) implies that 
each T = {fj}j^Ji is irreducible. Then II = {Ji}i& p has the desired properties. 

Lemma 4.9. Let f : [0 , 00) — > [0, 00) be a strictly convex function and let {aj}j e i n G M™ / or 
some n>d. If T = {/i}iel n *s a dp-local minimizer of Pf in the set 

0(a) = {£ = LjiW„ G W n : IN| 2 = «i , «eM, 
i/ien J 7 is a frame for H . 

Proof. Let II = {Ji}i<=i p be a partition of I n such that, if Ti = {/jjjeJi f° r * € I p , then {-7-ilieip is a 
partition of into irreducible subsequences. Recall that in this case the subspaces Wj = spanjj^} 
(i G I p ) are mutually orthogonal. Hence, it is easy to see that each subfamily T{ is a dp-local 
minimizer of Pf in the set 

{{9j}jeJi ■ 9j 6 , \\gi\\ = ||/i|| , j G Ji} . 

By [301 Corollary 3] and the properties of II, each T is a Cj-tight frame for W% , for some Cj > 0, 
i (zip . Therefore 

Notice that, in particular, Sjr fj = a fj for every j G J,; . 

Assume now that T is not a frame for Ti. Then, there exists j 6 L and q, s G J« such that 
(fqifs) 7^ 0, because otherwise would be a sequence of mutually orthogonal vectors and then, 
since n > d then we would have n = d and that span T = Ti. In particular, for this choice of 
indexes we have that a s = ||/ s || 2 < Q , because 

Ci \\fsf = (Sff s , f s ) >\(f s , f s )\ 2 + |(/ s , f q )\ 2 = {\\f s f + ME) ||/ s || 2 . 

We are assuming that kerSp 7^ {0}. Hence there exists g G kerSp with ||p|| = ||/ s ||. Let 

f s (t) = cos(i) ■ f s + sin(t) • g for every t G [0, 1] , 
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so that f s (0) = f s and / s (l) = g. Notice that ||/ s (t)|| = for every t G [0, 1]. Let F{t) be the 
sequence obtained from T by replacing f s by f s (t) and let s(t) denote the frame operator of Fit), 
for each t G [0, 1]. Then 

*(t) = [Sjr - (f s ® /,)] + /.(i) /.(i) for every f G [0, 1] . 

The inequality a s = \\f s \\ 2 < Q implies that Sjr — (/ s ® f s ) G A / Jd(C) + and also that R(Sjr — (/ s <g> 
/,)) = i?(S». Indeed, S> - (f s f s ) = [aj l (a - a s )} -f s ®fs + S> with S' G M d (C)+; in this 
case X(S') is obtained from X(Sj?) by setting one of the occurrences of q in X(S) equal to 0, and 
f s G ker S". Thus, 

S (t) = S'+ [aj 1 ( Ci - a s ) -f s ®fs + fs(t) f s (t)} with f s , f s (t) G ker S ' , (24) 

for every i G [0,1]. Using again the inequality a s = \\f s \\ 2 < Ci , let us define 

X(t) = AO7 1 (a - a.)] -f s ®fs + f.(t) ® /.(t)) = (Ai(t) , A 2 (t) , , ... , 0) G (R| )^ . 

Then A(0) = (q , , . . . , 0), A(l) = (a - a s , a s , , . . . , 0) 4 " and A 2 (i) > for t > 0. Then 
there exists to G (0,1) such that for < t < to, A 2 (i) < s for e > such that e < mini<j< p Cj 
and e < Xi(t) = (q — A 2 (i)). By the previous remarks, it follows that A(s(t)) is obtained from 
A(Sp) by replacing one occurrence of Cj by Ai(i) and one occurrence of by A 2 (t). Therefore, if 
r = rkSp then Aj(s (t)) < Xj(Sjr ) for 1 < j < r and tr S> = ££tj[ A,(s (*)) = tr s (t) imply that 
X(s{t)) ~< X(Sjr) for < t < t . 

These facts show that J- if) converges with respect to the dp-metric as t — > + , while Pj(J-(t)) < 
Pf(J~) for t G (0, to)- This contradicts the assumption that J 7 is a dp-local minimum of Pf and 
thus we should have that R(Sj^) = H, i.e. J 7 is a frame. □ 

Theorem 4.10. Let {J-q , a) be initial data for the CP. Let J- = [J~o , Q) G C^(J-q) be a dp-local 
minimizer of Pf on C^{Fo), f or some strictly convex function f : [0 , oo) — > [0, oo). Then T is a 
frame, i.e. S = Sjr e Ql(d) + . 

Proof. Denote by So = Sjr , A(5o) = A = X^, Si = Sg and A(Si) = ^ for some a < fi = Since 
T = (Tq , Q) G Ca P (J c o) ! by Theorem 13.31 there exists an ONB {vi : i G K^} of eigenvectors for Sq , X 
such that S = So + S\ = X)iei d (Aj + Hi) vi <8> vi . If S ^ Ql{d) + ', let 

r = max{i G I d : Aj ^ 0} < min{j G 1^ : ^ ^ 0} - 1 . (25) 

Then H r = span{tij : i > r} = ker So , and Si acts on % r . The minimality of T in Ca P (J r o) implies 
that is a dp-local minimizer of Pf in the set (n = k + n a ) 

B k (U r ) = {Q = {gi} i&k G U k r : \\gif = a t , i G I fc } , 

because A(5 + Sg) = (A, A(S e ) P/^o , = P/(^b) + Pf(^) for every Q G B fe (^ r ). By 
Lemma H21 we deduce that S*i G Gl(T-L r ) + , contradicting Eq. ([25|) . □ 

5 On the structure of global minimizers of Pf on C a (J-o) 

Let {J-q , a) be initial data for the CP and let / : [0, oo) — >• R be a strictly convex function. In this 
section we obtain a description of the geometrical structure of global minimizers of Pf on C a (J-o)- 
We accomplish this by studying the structure of dp-local minimizers of Pf in terms of perturbation 
results for the classical frame design problem. This geometrical structure of global minimizers allow 
us to obtain an finite step algorithm that produces a finite set (that does not depend on /) which 
completely describes the optimal frame completions T G C a (Po) for Pf. 
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5.1 Partitions into irreducible subsequences 

From now on we shall fix a strictly convex function / : [0 , oo) — > [0 , oo). 

The goal of this section is the following Theorem on the spectral and geometrical structure of global 
minimizers of Pf(-) on C^{J-q). The proof is divided into some lemmas that we state after the 
main result. Recall that r^(a) = {p G (M> )^ : a -< p}. 

Theorem 5.1. Let (Po > a) be initial data for the CP. Denote by A = X(Sjr Q ). Then 

1. There exists a vector p = p(X , a, /) £ r^(a) such that 

P = (Po , Q) G C a (Po) is a global minimizer of Pf T G Ca P (Po) and X^(Sg) = p . 

Assume now that T = (Po , Q) is a global minimizer of Pf on C^ p (Pq). Let {Gi}i& p be a partition 
of Q into irreducible subfamilies, where Gi = {/j'ljeJ; f or a partition {Ji}i& p of the set of indexes 
{i : 1 < i < k}. Then for each i G Ip 

2. The frame operators Sg i and Sj commute. 

3. There exists Ci G M>o such that Sjr fj = Ci fj for every j G Ji . 
Proof. Item 1 was shown in Theorem 13.41 

2. Assume now that T = (Po , (?) is a global minimizer of Pf on C°^(Po). Then 

Sg = ®S Gi a(S 1 )=\J a(S Qi ). 

i&p i&p 

Let P(a) (resp. Pi(a)) denote the spectral projection of Sg (resp. SgJ associated with a G cr(Sg) 
(or in case a ^ o"(5 , g i ))- Then, for every i G I p we have that 

Sg. = a Pi(a) with ^^Pj(a) = P(a) , a G o-(Sg) . 

aeu{Sjr) i& p 

Thus, each Pi(a) is a sub-projection of P(a) for i G I p . If we consider a G a(Sg), a / 0, then 
Corollary 13.51 shows that Pi(a) commutes with Sjr , for every i G I p . This last fact implies that 
Sg i commutes with Sj- Q , for every i G I p . 

3. It is a consequence of item 2 and the following Remark and Lemmas. □ 

Remark 5.2. Let (Po , a) be initial data for the CP and let t = tr a. Denote by Sq = Sj? and 
A = A (So). Consider the set 

U t (S , m) = {S + B : Be M d (C) + , rkB < d - m , tr (S + B) = t } , 

where n = k + n Q and m = d — k. It is shown in |33|, Theorem 3.12] that there exist ^-minimizers in 
Ut(So , m). Indeed, there exists v = u(X , m) G (M> )-'' such that S G Ut(So , m) is a ^-minimizer 
if and only if X(S) = v. In this case, there exist c > and {y i : i G Id}, an ONB for So and A such 
that 

1. S - S = J2i=i Pi-Vi<£> Vi, where p = p(X , m) = X(S - S )^; 

2. v = (A + p^)^ and Xi(So) + Pi = c whenever pi ^ 0. 
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As a consequence of these facts we get Sf = cf for every / G R(S — So). Moreover, if S' G 
Ut(So , m) is another matrix such that A(S' — Sq)^ = p and S' — So = Yli=i Pi w i ® w i i where 
{u>i : i G Id} is some ONB for So and A, then A(S') = f and S' is a -<-minimizer in Ut(So , m). 

Assume now that T = (To , G) G C a (J-"o) is such that So and Sg commute. Denote by 

1Z = R(Sg) , p = X^(Sg) , k' = rkSg , m! = d — k' = max{f G I<£ : /i, = 0} 

and r = tr a. Note that 1Z reduces Sj- . Write S-r. = Sf \tz G L(TZ)+ . We get the identity 

S To + L d (K)t = Sj- Q \ n x © {Sn + L(K)t) , (26) 

where Ld(1Z)+ is the sapce defined in Eq. §W\i . If we identify 1Z with C k> we have that 

S n + L(tt)+ = C^(Sr , 0) C Mk>(C) , 

where s = r + tr Sn . By the previous comments there exists S T £ S-^ + L(7Z)^ such that A(S T ) = 
v(X(Sti) , 0) G M>q , which is a ^-minimizer in U s (Sn , 0) = S& + L(lZ)f . As a consequence of Eq. 
(f26|) and Remark 1 2 .31 we conclude that 

5*1 = Stt |^± © S r G Sjf + Ld(TZ)+ is a ^-minimizer in Sj- Q + Ld(1Z)+ . 

Notice that A (Si) = ( X(Sj- \ 1l ±) , A(S r ) ) 4 G R d . Moreover, by items 1 and 2 above, we see that in 
this case there exists an ONB (for 7Z) {i>i}iei,, for Sn and X(Sn) G M k ' such that 

S r - S n = Pi v * ® ^ ' where P = X ^ ~ S ^ £ Rk ' ' ( 27 ) 

and there exists c G M>o such that Xi(Sn) + pi = c whenever pi ^ 0. Hence, in this case we obtain 
that 

S x f = cf for every / G R(S T - S n ) Q U . (28) 

A 

Lemma 5.3. Let (To , a) be initial data for the CP. Fix a subspace 1Z C C d which reduces Sj- Q . 
Let T = (J~o , Q) G C a (J-"o) be a dp-local minimizer of Pf on the set 

{ T' = (Fo , Q') G C a (.Fo) : R(Sg>) QTZ} . 

Assume further that So = Sj- and Sg commute and that the sequence Q is irreducible. Then 

1. The frame operator Sjr is a -<-minimizer in Sj- + Ld(1Z)^ . 

2. The subspace TZ is contained in a eigenspace of Sjr . 

In particular, there exists c G M>o such that Sjr f i = c/j , for n Q + 1 < i < n. 

Proof. Let k' = rkSg and m' = d — k! . Since by hypothesis So and Sg commute, arguing as in 
Remark 15.21 we conclude that there exists Si = Sj- Q \n± © S r G Sj? + Ld(7Z)^ such that Si is a 
-<-minimizer in Sjr Q + L^(TZ)^ . On the other hand, Sg and Sjr also commute so that there exists 
an ONB of C d of eigenvectors of Sjr and Sg , denoted {vi : i G Id}, such that {t>j}i g i fc/ is an ONB 
for S-ji = So\n G L(7Z)^ and A(S^). In other words 

Sjr = Oj ■ Vj (8) Vj , Sr, = ^ Xi(Sn) ■ Vi <S> Vi and Sg = ^ (3j ■ Vj © Vj , 
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for some (a;)f=i G K >o and (A)i=i G M >o- Let P = A (^V ~ S ^) t 6 Rfc ' be as in Ec l- © and 
consider the continuous curve s : [0, 1] — > Sp + Ld(lZ)+ given by 

s(x) = Sjr + ^ [x ■ Pi + (1 - x) ■ pi] -Vi^Vi for x G [0, 1] . 

iei fc / 

First, notice that s(x) is a segment (so, in particular, a continuous curve) joining s(0) = Si = 
Sjr \n± © S T and s(l) = Sp . Consider now the map h : [0, 1] — >■ R given by 

/*(*) = tr /(*(*)) = £ ieId /(A,(s(x))) 

= EiU'+i + E iG n fc , f(\(S-R.) + x ■ (3i + (1 - x) • pi) 

for every x G [0,1]. Since the sequence Q is irreducible then Corollary 14. 7\ implies that the map 
S : C a (.Fo) — > So + Ld(JZ)^ defined in Eq. (|23|) has a dp-continuous local cross section 95 around 
Sp such that <£>(Sp) = T . Then, the fact that J 7 is a tip-local minimizer of Pf implies that h has 
a local minimizer at 1 € [0, 1]. But this h is a strictly convex function on [0, 1] that has a global 
minimum at x = 0, since s(0) is a ^-minimizer in Sp + Ld(TZ)^ . 

This implies that h is constant on [0,1] and hence the segment A(s(x)), x G [0,1], reduces to a 
point. Thus = pi for every i £ % . Hence Sg = S T — S-r, and Sp = Sp © SV = Si . By Eq. 
([28)) of Remark 15. 2\ there exists a c G R>o such that Sp fi = S T fi = cfi for n + 1 < i < n (since 
fi G 1Z = R(Sg) = R(S T — S-ji) for these indexes). This last fact proves item 2 of the statement. □ 

Lemma 5.4. Let (JFq , a) be initial data for the CP. Let T = (To , Q) G C a (J-~o) be a dp-local 
minimizer of Pf on C a (Po). Let {Gi}i^i p be a partition of Q into irreducible subfamilies, where 
Qi = {fj}jeJi f or a partition {Ji}i^i p of the set of indexes {i : n a + 1 < i < n}. Assume that Sg t 
and So commute, for every i G I p . Then there exist positive numbers 

ci , . . . , Cp G R> such that Sj?fj = Cifj , j G Jj , i G I p . 

Proof. Notice that, by construction, the ranges of the frame operators Sg i and Sg- are orthogonal 
whenever i ^ j. Fix i G I p . The hypothesis allows us to apply Lemma 15.31 to the sequence 
(-7~o i Qi) G ^(J^)) where aj = (||/j H 2 )^^ • In this case we conclude that there exists q G R>o 
such that (Sp + SgJ fj = Ci fj , for every j G Jj . Hence, 

Srfj = (Sp + Sg) fj = (Sp + Sgjfj = (Sp + SgJ fj = a fj , 

leip 

for every j G J- L . □ 
5.2 A finite step algorithm to compute global minimizers 

In this section we obtain, as a consequence of Theorem 15. 1\ an algorithmic solution of the optimal 
frame completion problem with prescribed norms with respect to a general convex potential Pf. 
The key step is the introduction of the following finite set: 

5.5. Let (J-q , a) be initial data for the CP. In order to find the minimizers for the CP with 
parameters (J-q , a) we construct a finite set , a) C (R> )T as follows: 

Set r G Id . Consider a partition {Ki}i^i p of the set {r, . . . , d} for some 1 < p < (d — r) + 1 and 
define the subsequences of A = A(Sp ) given by 

= {^j}jeKi G R^ 1 , for every i £l p . 
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Consider also a partition {Ji}iei p of the set {l,...,k} and define the subsequences of a = {ai)\ =1 G 
M. k given by 

a « = {<Xj}j€Ji G K>o > for ever y i G I P • 
For each i £ I p define Cj = • (tr Aj + tr a*) and Tj = {cj — Ajjjg^. Let 

fi£R d be given by ^ = (r^ = a - Xj if j € K t , (29) 

and fij = ii j < r. We now check whether for every i G Ip it holds that: 

Ti G M^ 1 , ^ -< Ti and that /i = ^ G (M^, ) t . (30) 

In this case we declare this \i as a member of -^(.Fo , a). Otherwise we drop this \i. The set E(To , a) 
is then obtained by this procedure, as we vary 1 < r < d and the partitions previously considered. 
Therefore, E(To , a) is a finite set. 

A straightforward computation using Proposition 12.51 and Eq. (|3Q|) shows that for every 7 G 
E(Tq , a) there exists a completion T' = (To , Q') G Ca P (^b) such that A^(Sg/) = 7 and X(Sjri) = 
(A + 7)^. We remark that the set E(To , a) can be explicitly computed in a finite step algorithm, 
in terms of A = X(Sjr Q ) and a (see Section 1531 below for details). A 

Fix now a strictly convex function / : [0 , 00) — > [0 , 00). Recall that we denote by F : M> — > R>o 
the map given by ^(7) = Ylm d for evei T 7 G ^>o • 

Theorem 5.6. Lei (J-o > a ) ^ e initial data for the CP and let A = X(Sjr ). Then 

1. The vector ji = /x(A, a, /) G (R> )^ of Theorem I5.il satisfies that fi G E(Tq , a). 
Moreover, this vector (j, is uniquely determined by the equation 

F(X + fi)= min {F(X + 7) : 7 G E(Jb , a) } . (31) 

XTiai is, a completion T = (To , Q) G C a (To) is a Pj global minimizer if and only if T G Ca P (To), 
\i = X^(Sg) G E(Tq , a) and it satisfies Eq. (j3Tj) , 

Proof. Denote by \i = /u(A, a, /) G (R> )^ , the vector of Theorem 15.11 Let T = (To, Q) be 
a global minimizer of Pf on C a (J-"o)- In this case, by Theorem 13.11 Sj? and Sg commute and 
A(Sjr) = (A + /i)^, where fj, = fjJ G M> is such that A(5g) = /A 

Let {0j}iei p be a partition of into irreducible subfamilies, corresponding to the partition {Jj}jgi p 
of {n D + 1,. . . , n}, for some 1 < p < d. Notice that in this case Sg = ®iei„Sg i . This last fact 
shows that there exists a partition {Ki}i e i p such that X(Sg i ) = (Ti , 0j) where Tj = {/ijjjg^ and 
0- G R«H#<I for every j G I p . Then = (e^r^. 

Fix i G Ip . Theorem 15.11 implies that there exists Cj > such that Sj^fj = Ci fj for every j G Ji 
and Sg i and that Sjr commute. This fact implies that SfIj^ = Ci Ir { , where E4 = R(Sg i ) and Pj^ 
denotes the identity operator on R. L . Therefore, we conclude that Cj = Aj + fij for every j G K{ . 
Hence T, = (cj — Xj)j^K % and 

q = \Ki\~ 1 ■ ( A i + H) = ■ ( tr A * + tr MjeJi) > 

since 5^ = SjeJ t /?' ® • This shows that tr Sg i = \\fj\\ 2 = J2je.Ji a i • Moreover, the 

previous identity and Proposition 12.51 imply that aj -< Ti , where a^ = {aj}j£j. . Hence, we 
conclude that the vector fj, of Theorem 13.41 satisfies that \x G ^(^o , a), as defined in 15.51 

As we mentioned before, for every 7 G E(To , a) there exists a completion T' = (To , Q ') G Ca P (To) 
such that X^(Sg') = 7 and X(Sjn) = (A + 7)^. Hence the vector /j, satisfies Eq. (f3T|) . The converse 
implication now follows from item 1 and Theorem 13.41 □ 
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Remark 5.7. Let E(J-q , a) C (R> )f be the finite set denned in 15.51 and assume that there exists 
H G E(J-q , a) such that A + [i is a ^-minimizer for the set A + E(J-$ , a) i.e., such that 

A + fi -< A + 7 for every 7 G E(F Q , a) . (32) 

Then, by Theorem 15.61 and the comments in Section [2.31 we see that fi coincides with /i(A, a, /), 
the vector of Theorem 15.11 for all strictly convex functions / : [0 , 00) — > [0 , 00). 

That is, given an arbitrary strictly convex functions / : [0 , 00) — > [0 , 00) then a completion 
T = (To , Q) G C a (^"o) is a global minimizer of Pf in C a (.7"o) if and only if X^(Sg) = [i. Moreover, 
a similar argument shows that in this case 

X(S To ) +jii£ A° a p (X(S To )) is a ^-minimizer in A° a p (X(S To )) . 

Therefore fi (resp. X(Sj- ) + fj) is an structural (spectral) solution to the problem of minimizing 
Pf , in the sense that the solution does not depend of the particular choice of the strictly convex 
function /. 

Such structural solutions exist if we assume that the completion problem is feasible (see Remark 
12. 8p . Numerical examples suggest that such a majorization minimizer always exists (see Section 
15. 3|) . These facts induce the following conjecture: A 

Conjecture 5.8. Let (J-q , a) be initial data for the CP. Then there exists /i G E(J-q , a) such that 
Xjr Q + ^ satisfies the majorization minimality of Eq. (|32p . □ 



5.3 Algorithmic implementation: some examples and conjectures. 

As it was described in the previous section, an algorithm can be developed in order to compute 
explicitly the set E(Fq , a) and the finite set of possible minimizers v = X + fj,, \x G E(F$ , a) 
constructed from it. A proposed algorithm scheme is the following: 

5.9. Given the initial data A G (M> )^ and a = (aj)^ =1 , we set n = k + n as before. 

Step 1. For each r G I r set A(r) = (Xj)j =r . For such tail of A, of length I = d — r + 1, we consider 
the minimum m = {/, k}. Now, for each p G I m , 

• We compute all possible partitions of A(r) in p parts. We do the same with a. 

• Fixed a partition for A(r) and one of a, we pair the sets of both partitions and compute 
for every pair the constant c and check majorization as it was described in Eq. (|3U|) . 

• In case that the majorization conditions are satisfied for all pairs in these partitions for 
A(r) and a, the vector fi is constructed as in Eq. (f2"9"]l . 

• If fj, = fj,' then is \i stored in the set E(T§ , a). 

Step 2. The set A r (J r o , a) = {A + [i : \i G E(J-q , a)} is constructed from that stored data. 

Step 3. We search for the vector v G A r (J r o , a) of minimum euclidean norm. 

Then this v is a minimizer for the map F(x) = X^ie^ x i associated to the frame potential on 
the set {A(Sy) : T G C a (Fo)}. Moreover fi = u — X is the vector of Theorem 13.4} which allows 
to construct (via the Schur-Horn algorithm) optimal completions in Ca P (^o) with respect to the 
Benedetto-Fickus's frame potential. By Theorem 15.61 the globarl minimizers corresponding to a 
different potential in C a G^o) can be computed similarly, i.e. by minimizing the corresponding 
convex function on the set N(Fq , a). 

Step 4. Finally, we test if the vector v obtained in Step 3 is a minimizer for majorization in 
N{T§ , a). In that case, the algorithm succeed in finding the minimizer for every convex potential 
P f . ' " A 
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In all examples in which we have applied the previous algorithm, the Step 4 confirmed that the 
minimizer for the frame potential in N(J-o , a) is actually the minimizer for majorization, which 
suggests a positive answer to the Conjecture 15.81 (see the comments in Remark 15, 7p . 

Example 5.10. Consider the set of vectors J-q € F(7, 5) given in ([6]) and let a = {3.5, 2} as it 
was pointed out in Subsection 12.4^ with that initial data, the completion problem is not feasible. 
Nevertheless, if we apply the algorithm described above, the optimal spectrum /i and v can be 
computed, since we can describe the set N(To , a). 

Indeed in this case N(T , a) = {(9 , 5 , 4.5 , 4 , 4) , (9 , 6.5 , 5 , 4 , 2)} so v = (9 , 5 , 4.5 , 4 , 4) 
(where fj, = (0 , , , 2 , 3.5)) and an optimal completion is given by: 



0.0441 -1.3541 

0.6901 0.5701 

-1.2093 0.0887 

-0.0569 0.8836 

0.2371 -0.7435 



(33) 



In this case, the vector [i is constructed with the partitions K\ = {2}, ^{l} of the two smaller 
eigenvalues in A = A(Sj- ) = (9,5,4,2,1) which are paired with J\ = {2} and J2 = {3.5} of a, 
using the notation introduced in Section [ 



If we now set a = (2 , \ , \ , 4), again the problem is not feasible (see [33]). In this case the 
algorithm yields a N(J-q , a) with 23 elements with a minimizer for majorization given by v = 
(9, 5, 4, 3, 2.75). In this case, the partitions of A are K\ and K2 of previous example, and 
Jl = {2 > I j 4} an d J2 = {2} is the partition of a. Finally, an optimal completion of with 
prescribed norms is given by: 



0.0156 0.0156 0.0156 -1.0236 

0.2440 0.2440 0.2440 0.4310 

-0.4275 -0.4275 -0.4275 0.0670 

-0.0201 -0.0201 -0.0201 0.6679 

0.0838 0.0838 0.0838 -0.5620 



(34) 



Example 5.11. If a = (5.35, 4.66, 3.2, 2.5, 1.2, 1, 0.65) and let T be any family in F(n , 6) 
such that A = X(Sjr ) = (5.75, 5.4, 4.25, 4.25, 3, 2), (this is also a non-feasible example) then 
N(T , a) has 744 elements, and a minimizer is v = (7.505, 7.505, 7.45, 6.9167, 6.9167, 6.9167). 
In this example, the partitions for A (ro = 1) and a involved in the computation of the optimal [i 
are K\ = {5.75 , 5.4 , 4.25}, K 2 = {4.25} and K 3 = {3 , 2} and J x = {2.5 , 1.2 , 1 , 0.65}, J 2 = {3.2} 
and J3 = {5.35 , 4.66} respectively. A 

It is worth to note that the number of iterations done in Step 1 grows rapidly with d and k, and 
the size of N(Fo , a) also increases. As a consequence of these facts, the algorithm described in 
15.91 is hard to implement for completion problems involving a large number of prescribed norms 
or for completion problems in C d for large d. Nevertheless, in the previous examples (and several 
others considered for this work) it turned out (besides the fact that Conjecture 15.81 is verified in all 
examples) that the index-partition of A and a in the ^-minimizer consist of sets of consecutive 
elements, both for A and a. Moreover, in all examples the partitions are paired in such a way that 
the partitions with the greater elements of A corresponds to those of a with the smaller entries 
(see the description of A$ and Jj in previous examples). Moreover, in all examples considered, the 
minimizer has the property that the sets of vectors corresponding to the partitions with the greater 
norms of a are linearly independent, with the exception of the last partition of a. This structure is 
consistent with the solution for the classical completion problem with T§ = ( see [2| 1141 130]). 

This allows to develop a faster algorithm which tests a smaller set of partitions for A and a which 
reduces considerably the time of computation and data storage. Thus, our numerical computations 
lead to the following Conjecture for the construction of the ^(-minimizer: 
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Conjecture 5.12. Let {J-q , a) be initial data for the CP, and assume that a is arranged in 
decreasing order. Then, using the notations of 15.51 the minimizing vector [i E E(J-q , a) of Theorem 
15.61 satisfies that: 

1. It is constructed from consecutive partitions of A and a. In other words, that each set Jj and 
Kj in the partitions {Jj}j£i p and {Kj}j e i p given in 15.51 describing fj,, consists of consecutive 
indexes. 

2. The partitions of A and a are paired in opposite order: the sets in the partition of A with 
the larger elements are compared with those sets in the correspondent partition of a with 
the smaller elements. Moreover, the correspondent sets in both partitions have the same 
number of elements, except possibly the sets with the smallest and greatest entries of a and 
A respectively. More explicitly, there exists 1 < ro < d such that m = d — ro + 1 < k and a 
sequence ro < T\ < . . . < r p = d such that: 

K 3 = { r i-i + 1 1 • • • ' r j} ' Jj = {d-rj + l, ... , d- rj-i} , for 2<j<p, 
Kt = {r , . . . , n} , Ji = {d - ri + 1 , . . . , k} , 
and such that /i is constructed as in 15.51 in terms of {Kj}j<=i p and {Jj}j£i p ■ A 

In the following example we verify that the algorithm implemented following the scheme in 15.91 
and the simplified (and faster) version of this algorithm that assumes that Conjecture 15.121 holds, 
produce the same solution to the optimal completion problem with respect to the Benedetto-Fickus' 
frame potential. 

Example 5.13. Given the initial data 

A = X(Sjr ) = (7, 6, 5.5, 4, 2.5, 1, 0.5, 0.3) and a = (5 , 4.5 , 1.2 , 1 , 0.8, 0.5) , 

then applying the algorithm described in !5.9l we obtain that the optimal completion with prescribed 
norms T = (J-'o, Q) has eigenvalues v = (7,6, 5.5, 5.3, 5,4, 3.5, 3.5). If we only check the 
partitions described in Conjecture I5.12| then we obtain the same optimal eigenvalues v, with 
the partitions J x = {1.2, 1, 0.8, 0.5}, J 2 = {4.5}, J 3 = {5} and K x = {2.5, 1}, K 2 = {0.5}, 
K3 = {0.3} for a and A respectively (ro = 5). But there are only 5 cases constructed from this 
kind of partitions in a set N(J-q , a) with 322 elements. A 

6 Appendix: Equality in Lindskii's inequality 

Fix So G Md(C) + . In this section we characterize those matrices 

Si G M d (C) + such that A(5 + Si) = ( A^(5 ) + A t (5i)) 4 . (35) 

If Si € M.<i{C) + satisfies Eq. (|35p then we say that Si is an optimal matching matrix for Sq . 
Note that optimal matching matrices correspond to the cases of equality in Lindskii's inequality, 
as stated in Theorem 12.41 

Although we have defined this notion for positive matrices (since we interested in its application 
to frame operators) similar definitions and conclusions holds for general hermitian matrices (by 
translations by convenient multiples of the identity). 
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6.1 Optimal matching matrices commute 

In this section we study the case of equality in Lindskii's inequality and show that if Si is an 
optimal matching for So (i.e. Si is as in Eq. (j35|) ) then So Si = Si So . 

We begin by revisiting some classical matrix analysis results. We shall give short proofs of them in 
order to handle these proofs for the equality cases in which we are interested here. 

Lemma 6.1 (Weyl's inequalities). Let A, B G H(d). Then, 

X j (A + B)<X i (A) + X j - i+l (B) for i<j, (36) 

X j {A + B)>X i (A) + X j - i+d (B) for i>j. (37) 
Moreover, if there exists i < j (resp. i > j) such that 

Xj(A + B) = Xi(A) + Xj-i+i(B) (38) 

(resp. Xj(A + B) = \i(A) + Xj-i + d (B)) then there exists a unit vector x such that 

(A + B)x = Xj(A + B)x, Ax = Xi(A)x, Bx = Xj- i+1 (B)x , 

(resp. (A + B)x = Xj(A + B)x , A x = Aj (A) x , B x = Xj- i+ d (B) x). 

Proof. We begin by proving ([36]) . Let uj , vj and Wj denote the eigenvectors of A, B and A + B 
respectively, corresponding to their eigenvalues arranged in decreasing order. Let i < j and consider 
the three subspaces spanned by the sets {w\, . . . , Wj}, {u{, . . . , u n } and {vj-i+i, . . . , v n }. Since the 
dimensions of these subspaces are j, n — i + 1 and n — j + i respectively, we see that they have a 
non trivial intersection. If x is a unit vector in the intersection of these subspaces then 

Xj(A + B) <{(A + B)x,x) = (Ax,x} + (B x , x) < \(A) + X^ i+1 {B) . 

If we further assume that equality ([38]) holds for these indexes then we deduce that 

{(A + B)x, x) = Xj(A + B) , (Ax,x) = Xi(A) and (B x , x) = Xj^ i+1 (B) . 

Because x lies in the intersection of the previous subspaces, these last facts imply that (A + B) x = 
Xj(A + B) x, Ax = Xi(A) x and (B x, x) = Xj~i + \{B) x. The inequality (f3T|) and the equality ([38]) 
for the case i > j follow similarly. □ 

Corollary 6.2 (Weyl's monotonicity principle). Let A £ 7i(d) and B € A^d(C) + . Then 

Xj(A + B)> Xj(A) for every j G I d . (39) 

If there exists J C ILj such that Xj(A + B) = Xj(A) for every j E J, then there exists an orthonormal 
system {xj}j<=j such that Axj = Xj(A) Xj and B Xj = for every j G J. 

Proof. Inequality (|39p follows easily from Lemma 16.11 (with i = j). The second part follows by 
induction on the set \J\: Fix jo G J. By Eq. (f3T|) with i = j = jo , there exists a unit vector Xj 
such that Axj = Xj (A) Xj and B Xj = Xd(B) Xj = 0. 

This proves the case |J| = 1. If \ J\ > 1, consider the space W = {xj } C. C d which reduces A, B 
and A + B. Let I = {j : j G J , j < jo} U { j - 1 : j G J , j > jo}- The operators A\ w G L(W) sa 
and B\w G L(W) + satisfy that Aj(^4|iy + B\w) = Xj(A\w) for every j G /, with \I\ = \ J\ — 1. 
By the inductive hypothesis we can find an orthonormal system {xj}j^i C W which satisfy the 
desidered properties. □ 
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Proposition 6.3. Let A, B € H(d). Then the equality 

( \{A + B) - \(A) ) l = X(B) =>• A and B commute . 

Proof. We can assume that B is not a multiple of the identity. By hypothesis, there exists permu- 
tation a G §d such that \j(B) = X a ^{A + B) — X a ij\{A) for every J G I<£ • Therefore, there exists 
an increasing sequence {Jk}t=i °f subsets of 1^ such that \J^\ = k and 

k 

x j( A + B)- Xj(A) = Xj(B) for every kel d . (40) 
jeJ fc j=i 

Let /c E Id be such that Xk-i(B) > Xk(B) (recall that B ^ al for a S M). Let us denote by 
B^ = B — Xk(B) I and notice Eq. (|40p also holds if we replace B by B^ . 

By construction Xk(Bk) = and the orthogonal projection onto the kernel of the positive part B^ G 
A4d(C) + coincides with the spectral projection of the B associated to the interval (— oo, Xk(B)]. 
Moreover, dimker B^ = d — k + 1. 

Since B^ G A4d(C) + and B^ < B^ then Weyl's monotonicity principle implies that 

X j (A + B k )<X j (A + B+), jel d => £ AjCA + flfc)^ ^ A i (A + J B+). 

j£Jk-i jeJk-i 

Therefore 

^ A^ + ^-A,^) < X M + B k)~ X M) 

jeJfc-i jeJk-i 

j&d 

fc-i 

= tr(A + S+)-tr^ = ^A j (5 fc ) 

i=i 

since Aj(A + 1?^) > Aj(^4) for j G Id - again by Weyl's monotonicity principle - and since, by 
hypothesis, Xk(Bk) = 0. The inequalities above are the key part of the proof of Lindskii's Theorem 
1211 (X(A + B)- X(A) -< X(B) ). But here they actually equalities, by Eq. (jlUD . 

Let J%_i = Id \ Jk-i- Then, from the above equalities we get that Xj(A + B^) = Xj(A) for 
every j G J^-i ■ By Corollary 16.21 there exists an ONS {xj}j^jc such that Axj = Xj(A)xj and 
B£ x j = ® f° r ever y 3 £ Jk-i • these facts together imply that 

Pk = ^ X 3 ® X i = P kcr B+ aIld PkA = AP k . 

Recall that P^ is also the spectral projection of B associated to the interval (— oo, Xk(B)], for any 
k G I d such that Xk-i(B) > Xk(B). Since the spectral projection of B associated with (— oo, Xi(B)] 
equals the identity operator, and B is a linear combination of the projections P^ and /, we conclude 
that A and B commute. □ 

Now we are ready to prove that if Si G M.d(C) + is as in Eq. ([35]) then So Si = Si So . 

Theorem 6.4. Let So , Si G H(d) be such that A(S + Si) = ( A(S ) + A^(Si) ) l . Then S and Si 
commute. 

Proof. Take B = S + Si and A = -Si . Therefore -X(A) = X^(-A) = A t (S i ), so that X(A + B) - 
X(A) = A(So) + A^(Si). Hence A and B satisfy the assumptions in Proposition 16.31 and they must 
commute. In this case So and Si also commute. □ 
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6.2 Characterization of optimal matching matrices 

Let So G .Md(C) + and let S\ G A / id{ ( C) + be an optimal matching matrix for Sq. Then, Theorem 
16.41 implies that So Si = S\ Sq and hence there exists a common ONB of eigenvectors for So and 
S\. In order to complete describe Sq and S\ we first consider some technical results. 

We begin by fixing some notations. Let A G M> . For every j G Id we define the set 

L{\ , j) = {iel d :\i = Xj} . 

If we assume that A = X^ or A = A^ then the sets L(j) are formed by consecutive integers. In the 
firs case we have that Aj < Xj => k > I for every k G L(A , i) and I G L(A , j). 

Given a permutation a G §d and A G R> we denote by A CT = (A^m , . . . , A^))- Observe that 

A — A(j A = A (j—i <r(L(A , j) ) = L(A , j) for every j G I d . (41) 

The following inequality is well known (see for example II.5.15]): 

Proposition 6.5 (Rearrangement inequality for products of sums). Let A , \i G M> be such that 
A = A^ and \i = . Then nf=i(^« + Mi) — lLf=i(Ai + Mo-(i)) f°r every permutation a G . 

The following result deals with the case of equality in the last inequality. 

Proposition 6.6. Let A, \i G R> ^ e suc ^ A = A^ and \i = fv. Let a G §d 6e suc/i t/iat 

( A + ^ = (A + ^ . 

Moreover, assume that a also satisfies that: 

if r , s G Id are such that /i CT ( r ) = £t CT (s) with <r(r) < a(s) then r < s . (42) 

T/ien the permutation a satisfies that X = X a . 

Proof. For every r G let F(r) = riiLi(^« + Mr(i))- By the hypothesis and Proposition 16.51 

F(cr) = F(id) = maxF(r) . 

Assume that A ^ A CT -i . In this case there exists j , k G Id such that 

< fi k and A CT -i (j) < A CT -i( fe ) . (43) 

Indeed, let jo be the smallest index such that a^ 1 does not restrict to a permutation on L(X , jo). 
Then, there exists j G L(A, j ) such that o- -1 (j) ^ L(A, j ). As cr _1 (L(A, j ) \ {j}) jo) 
there also exists A; ^ L(A , jo) such that <t _1 (/c) G L(A , jo). They have the required properties: 

• First note that X a -i(j\ < Xj = X a -ir k \ (and then also a (j) > a^ 1 (k)) because c _1 (j) can 
not be in L(A , jo) nor in L(X , r) for any r < jo (where o~~ l acts as a permutation). 

• A similar argument shows that j < k. We have used in both cases that the sets L(A , j) are 
formed by consecutive integers, since the vector A is decreasingly ordered. 

• Observe that j < k =>■ fij < . So it suffices to show that fij ^ ^ . Let us denote by 
r = fJ _1 (j) and s = a^ 1 (k). The previous items show that r > s and <r(r) < o~(s). Hence the 
equality fij = fx a M = Mo-fs) = is forbidden by our hypothesis (j4"2j) . 



26 



50 Eq. (|43p is proved. Consider now the permutation r = a 1 o (j , k), where (j , k) stands for the 
transposition of the indexes j and k. Straightforward computations show that 

(A CT -i(j) + /ij) (A .-i( fc ) + /ifc) - (A CT -i(j) + ilk) (A CT -i(fc) + Mj) = - A CT -i( fc )) (/ife - /ij) < . 

From the previous inequality we conclude that -F(id) = F{a) < F(t) < -F(id). This contradiction 
arises from the assumption A ^ Therefore A = A CT -i © Ao- as desired. □ 

Remark 6.7. Let A, fj, G M> ^ e suc h that A = A^ and /i = Let r G be such that 
(A + fj,)^ = (A + fJ, T )^. Then, by considering convenient permutations of the sets L(/j, , j) we can 
always replace t by a in such a way that \i a = /i T and such that this a satisfies the condition (|42p 
of Proposition 16.61 Hence, in this case (A + n)^ = (A + fi a )^ and the previous result applies. A 

Theorem 6.8 (Equality in Lindskii's inequality). Let Sq 6 A4d{C) + and let Si G A4d(C) + be an 
optimal matching matrix for So . Let A = A (So) an d \i = A^(Si). Then there exists {vi : i G 1^} a 
ONB for So and A such that 

Si=} j fii-Vi®v i and S + Si = (Aj + m) Vi®Vi . (44) 

Proof. Let us assume further that So , Si are invertible matrices so that A , [i G M^g . By Theorem 
16.41 we see that So and Si commute. Then, there exists B = {wi : i G 1^} an ONB for So and A 
such that Si Wi = n T u\ Wi for every i G Id , and for some permutation r G Ed - Therefore 

(A + ^! I A(So + Si) = (A + / x T ) 4 . 

By Remark 16.71 we can replace r by a G in such a way that \i T = \i a , (A + fi)^ = (A + & n d <J 
satisfies the hypothesis (f4*2|) . Hence, by Proposition 16.61 we deduce that A CT -i = A. Therefore one 
easily checks that the ONB formed by the vectors v- t = w a -iu\ for i G 1^ (i.e. the rearrangement 
iBo—i of B) is still a ONB for So and A, but it now satisfies Eq. (f4"4"j) . 

In case So or Si are not invertible, we can argue as above with the matrices So = So + / and 

51 = Si + /. These matrices are invertible and such that Si is an optimal matching for So . 
Further, A(So) = A(So) + 1 and A (Si) = A(Si) + 1. Hence, if {vi : i G I<f} has the desired 
properties for So and Si then this ONB also has the desired properties for So and Si . □ 
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